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ABSTRACT 

The authors examine published research in speech 
communication and evaluate its potential for theory development. Two 
major suggestions are advanced that will facilitate the quest for 
viable theory of speech communication. Firsts research should begin 
to focus on relevant communication behaviors rather than merely using 
them as convenient contexts to test selected theories. Second, 
researchers should be required to report the degree of association 
between the selected independent variables and the dependent 
communication behaviors. Unless these suggestions are adopted, it is 
the authors* contention that the quest for viable theories will be 
hindered. The incorporation of the suggestions will assist the field 
to (1) compare theories in terms of their ability to predict 
communication behaviors, and (2) construct viable theories of 
communication behavior. (Author) 
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Speech communication is in the throes of an evolu- 
tion. Like other branches of knowledge such as psychology , 
socioloay, and political sofCnce, speech communication 
is following the usual progression of development. The 
discipline "begins with armchair speculation, proceeds 
to observation by extreme empiricists who .say 'let the 
data sneak for themselves 1 and finally gets to the point 
of testing of hypotheses and theories ."^ 

Those of us trained in the scientific method realize 
that the desired aoal in the behavioral sciences "is 
theory that is trulv comprehensive..."* ?*ost researchers 
seem to agree that research which is most instrumental 
to the development of an intellectual discipline is con- 
ducted within the context of theory development. wJ Theory 
construction, then, is our goal. 

It is the position of this paper that present 
practices of conductina and reporting research preclude 
the attainment of viable theories of communication, rirst, 
present research does not systematically explore communi- 
cation behaviors. Second, present journal articles and 
research monoaraphs do not provide readers with informa- 
tion concerning the importance of independent variables 
in producing effects on dependent variables. 
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I. THE FAILURE TO FOCUS 01! 
* C0?-1MUNICATI0N BEHAVIORS 

Accordina to the New Orleans Conference on Research 
and Instructional Development, the speech communication 
discipline should emphasize "the behavioral antecedents 
and consequents of messages and their variations, as 
veil.. .as the ways that messages interact with communi- 
cation participants to produce behavioral outcomes ." 4 
This and other recommendations of the New Orleans Con- 
ference indicate that knowledge of communication behavior 
and research that leads to such knowledge should be of 
naramount concern. In other words, we must seek a 
multiplv-connected set of empiricallv extensible con- 
structs . 5 One would assume that with this aim quantita- 
tive research in communication would be directed toward 
the illumination of communication behavior, 

A review of current literature, however, reveals 
that most researchers do not systematically pursue this 
goal* Rather than examinincr a particular communicative 
behavior from various perspectives, many researchers seem 
to be concerned with demons tr at incr the predictive validity 
of a "net" theory. Frecruently, the behaviors examined 
seem to he merely convenient contexts within which to 
test a theorv. The research is apparently directed toward 
attainincr Vnowledge of the antecedent elements of the 
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antecedent-con sequent relationships. Knowledge of the 
effects of specified independent variables is, therefore, 
crrot-Tir.cr, hut our understanding of the process of communi- 
catior is advancing slovly. Although many studies could 
be cited, a varietv of representative worbs will demonstrate 
the nr*»sent focus of research. 

Dissonance theory has been tested in many behavioral 

contexts and the research can be represented as in 

6 

° inure 1. 
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Fiaure 1 

» 

Fere, the theory, cognitive dissonance, is the focal point 
of the research proaram and any gain in understand incr of 
the various behaviors examined is apparently coincidental . 
The pumose of the experimentation is validation of the 
theory . 

The review article by "araulis and Songer, v/hich 
collected all the experimental vork conducted within the 
dissonance context, epitomizes the overriding concern for 
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theories. Three hundred and nineteen separate studies 

were listed who<*e only commonality was the fact that 

"cognitive dissonance theory. . t was relevant to the publi- 
8 

cation." Knowledge of the predictive validity of the 
theory was paramount while knowledge of the various be- 
haviors was onlv of secondary interest. 

Experimentation on the variable of ego-involvement 
further illustrates the noi - # Investigators have tried 
to demonstrate the effects of ego- involvement on such 
diverse dependent measures as attitude change, ability 
of dyads to reach agreement, and communicator credibility. 

Fven when experimental investigations are launched 
outside the parameters of a given theory, the focus re- 
mains on independent variables. Two studies are repre- 
sentative of this genre of research: Barker, Kibler, 

9 

and Kelley, and Kibler and Barker. while these studies 
can be interpreted as investigating speech effectiveness 
ratings and comprehension, the apparent motivation behind 
the initiation of both studies, when considered together, 
is the manipulation of the variable of mispronunciation. 

All the above studies manifest a corollary to Kaplan's 
Law of Instrument — manipulate your favorite independent 
variable in every behavioral context and sooner or later 
vou will find something it affects.**' 

Textbooks and reference books also focus on theories 
and independent variables rather than communication behavior. 

O 
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In Persuasiv e Communication by Bettinghaus, for instance, 
the results of numberous experiments are organized accord- 
ing to the independent variable-regardless of the dependent 
variable of the experiment. 11 The apparent interest is 
knowledge of the effects of independent variables, insko's 
Theories of Attitude Change , while it serves as a valuable 

reference work, also stresses theories and independent 
12 

variables. it is organized into chapters solely on the 
basis of the various theories discussed. Again, the 
ostensible interest is knowledge of a theory's predictive 
validity and not specific communication behaviors. An- 
other widely used text, Attitude Change and Social Influ- ' 
ence bv Cohen, manifests an overriding concern for the 
various effects of nurberous independent variables. 13 
Cohen discussed the results of experiments under such 
headings as: The Effects of ftating a Conclusion, The 
Effects of Order of Presentation, and Studies of The 
Effects of Approval and Disapproval. 14 The way in which 
the book is organized suggests that knowledge of the 
effects of independent variables is more important than 
knowledge of the various determinants of specific communi- 
cation behaviors. 

Finally, Thompson's ambitious compilation of the 

nuantitative research in communication through 1964 should 
15 

be considered. Thompson offered generalizations based 
on research and then cited studies to support each general- 



-6 



ization. The following generalizations are indicative 
of the book's focus: 

(1) Moderately poor vocal cmality, poor pitch 
patterns, nonfluency, and even stutterina 
do not interfere sianif icantlv with com-* 
prehension. 16 

(2) Delivery affects comprehension and per- 
suasiveness significantly. 17 

(3) Sentence length, vocabulary, and certain 
stylistic devices probably increase 
comprehens ion • 1 8 

(4) Ethos does not appear to affect learning. 19 

(5) Climax and anticlimax methods of orcrani- 
zation do not differ significantly in 
persuasiveness. . .20 

(6) Disorcranizaticn appears to affect compre- 
hension in written communication, but 
effects upon comprehension and effectiveness 
in oral communication are doubtful. 21 

These examples illustrate two important characteristics of 
current research strategy. First, by making an independent 
variable the subject of each generalization, Thompson 
indicates that knowledae of independent variables is para- 
mount. Second, although four of the generalizations 
directly concern comprehension, no attempt is made to 
consider the relative importance of the various determin- 
ants — because research which aenerates such comparisons 
is scant. 

Focusincr on theories and independent variables has 
had a dramatic impact on theory buildina and the advance- 
ment of knowledae of communication behavior. Examine 
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^ioure 2, t»here the corrnnunication behaviors are numbered 
(behavior number 1 is the same across all the diagrams). 

123 12 123 
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— w. .. , • • I 
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Figure 2 
(#*s = behaviors) 

which theorv best explains behavior number 2? If that 
W*havior i* attitude change, for instance, the selection 
of the best theoretic explanation is often based on the 
researcher's current interests rather than on the theory's 
ability to predict behavior number 2, Pev r experiments 
compare the theories in terms of their ability to predict 
and explain behavior number 2. The lack of experimentation 
comparing theoretic explanations nrompts the coexistence of 
many theories, often contradictory, pur^ortina to explain 
the sane behavior. Furthermore, because theories are 
rarelv directly compared, the relative contribution of 
various determinants of a aiven behavior are unknown. 

The detrimental effect of this pervasive research 
stratecrv can be at least partiallv alleviated by focusina 



on behavior . That is, we need to determine the relative 

predictive accuracy of each theorv in explaining the same 

behavior. Only then will knowledge of the process of 

communication be advanced. Obviously, this goal can only 

be achieved throuoh a series of multivariate research 

projects. Cohen recocrnized the necessity for comparative 

research after he reviewed the single variable research 

using message variables and he said, "As is true for the 

entire area of persuasive communication and attitude 

change. ..future studv should be based... on the conducting 

of crucial exneriments which pit one theoretical approach 

22 

aoamst another." ?v. example of the recommended strategy 
may help claritv this approach. 

If attitude change as a result of persuasive communi- 
cation is the behavior of interest, it is known that many 
classes of variables have been shown to affect this be- 
havior. To choose just one such class of variables for 
purpose or illustration, the ouestion might be asked, 
,,,T hat is the relative importance of the various message 
variables that have been p reviousxy found to affect per- 
suasive impact?" Such a nvestion arises out of the know- 
ledcre that variables x, y, z, and w have been shown to 
have a significant effect on attitude chance when manip- 
ulated independent lv. The research program necessitated 
bv this ouestion can be schematized as in Figure 3. 
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Fiaure 3 

In this program of research, two or pore variables vould 
be **»multaneouslv manipulated and their relative impact 
on the manifest attitude change determined. A series 
of experiments successivelv including and excluding all 
of the identified variables vould result, ultimately, 
in a vertical classification of the relative importance 
of all of the variables as determinants of the behavior 
examined. The same tvne of exnerimentally-generated 
hierarchy could be derived for theories. That is, a 
series of experiments could be conducted to determine 
th<* relative predictive accuracy of all theories pre- 
rumina to exnlain a aiven behavior. 

Though the sucraested chanae in research strategy is 
simple, the impact of its adontion vould be great. Most 
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research projects currently establish that variable 

X affects behavior * or that theory 2 predicts behavior 

B. research conducted with the organization suggested 
ir thi<* naner will be able to assert that variable X 
affoctP behavior /» either more, le«?s, or the same as 
variables II, "V, v\ and Y or that S predicts with greater, 
lesser, or eoual accuracy "hen compared with theories 

C, D, F, and The current approach to research, vields 
krot'ledoe of theories and variables; the recommended 
strateov "ould advance hr.ovOedoe of behavior in terms 

of theories and variables. 

The "rorooed research stratecry has a number of 
important implications. First, the increased concern 
with ^no'-'ledae of communication behavior mav necessitate 
p areater specif ication of dependent variables. For 
instance, the questions mav be ashed: ".are two theories 
o* attitude chancre reall" attempting to explain the same 
phenomenon or doe= one explain such mediating processes 
as Percent! on, attention, or comprehension?" "Is con- 
forritv the same dependent variable whether it results 
from compliance or internalization?" In «-hort, a concern 
for understandina communication behavior would necessitate 
a close examination of the nature of the various behaviors 
in which communication researchers are interested. 

fecond, the multivariate techniques reouired for 
the ^ r ogram of research, succrested here must be mastered. 
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communication researchers. Evidence of .increased 
methodological sophistication can K e found in the journals, 
but it seems essential that r.ulitvariate techniaues must 
be understood not *isroly because tbev allo T * a researcher 
to manipulate two or more variables but also because only 
throuah their utilization can the relative impact of vari- 
ables on the behavior examined be assessed directly. 

Third, comparative research "will lead theories to 
expand to encomnass net* conditions" and "speak to the 

comparative viability of one theorv in relation to an- 
23 

other." "In due tine, the less viable theories will be 
cast aside and the more tenable oner "ill survive and 
become guides for future research, -and they will become the 
objects of conceptual modification. 

IT. THE ^AILUPF TO EFTir*TF TFF ?7L0KITUDE 
OP INDEPEKDE'T VARIABLT EFFECTS 

If the field of Speech Communication is going to 
attemnt to assess the relative impact of independent vari- 
ables on communication behaviors, then current research 
renorts need to be expanded. Tvnically, if the independent 
variable (s) produces statistically significant changes in 
the dependent variable (s) the experiment is interpreted 
as addina sunport to the selected theorv. f'hile the test 
of statistical sianificance is frequently presumed to 
represent a sufficient te*t of an hvnothesis, it is not. 
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*<? one sociolooist notes, "It is never a sufficient 

condition for concludina that a theorv has been corrob- 
25 

orated..." 

The test of statistical significance only tells us, 
within a certain percent chance of being tfong, that 
chance factors are rejected as the explanation. T* e infer, 
therefore, that the independent variable or variables pro- 
duced the scores on the dependent variable. One difficulty 
t-ith tests of sionificance is that a very *?eak statistical 
relationship tiill be detected because sicmif icance is 
easv to achieve. Fays notes that "virtually any study 
can be made to shov; sianificant results if one uses enough 

subjects, regardless of how nonsensical the content may 
26 

be." 

Ve can add to the usefulness of statistical tests bv 
measuring the relative macmitude of impact that independent 
variables have on denendent behavior*.. If we are attempting 
to svnthesize research, a "coherent synthesis cannot be forg- 
ed from a collection of relationships of unknot >n strengths 
and magnitudes. The necessary conditions for a synthesis 
include an evaluation of the results available in the field, 
a coherent .interrelating of the magnitude found in those 

results, and the construction of models based on those macrni- 
27 

tudes." The magnitude of an association between two vari- 
ables is not measured by a test of significance. " A signifi- 
chat * statistic merely indicates a relationship exists, but, as 
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Havs notes "...in no sense does this near, that an impor- 
tant dearee of association necessarilv exists." 2 ^ 

If the development of coherent theory depends unon 
Vr.o^ledge of the decrree of association between an inde- 
pendent variable and denendent variable, ?>nd the te*ts 
of significance do not provide this information, ho" can 
researchers attain it' T-Tiat needs to be done is to com- 
pute the nercent of denendent variable variance accounted 
for bv the independent variable. If an independent 
variable accounts for all the variance in the dependent 
variable, then, of course, the Phenomenon is explained 
in tbat case. Conserrupntlv, the closer to 100% of the 
dependent variable variance that i*- explained the stronger 
is the relationship between the independent and dependent 
variables . 

As Fiaure 4 illustrates, the forrulas for assessing 
the imnact of the independent variable on variables 
are already available, m correlational studies using 
the Pearson r, the percent of the variance explained by 
the independent variable is simple r 2 . In chi-souare 
analvse=, the strength of the association can be measured 
bv numerous techniques. The most generally applicable 
measure seems to be Cramer's statistic. *:ith appropri- 
ate adjustments for the number of cells, it can become 
a standard measure which vill varv between 0 and 1.0. 2 9 
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fVasure of Ptrenath of 
Independent Variable- Effects 



Fixed Effects 



est. t' 2 = t 2 -l 



(a) 



t2 «-l = TT 2- 1 



est, vr= FSBetvreen- (J-1)?!S T 7 ithin 
FFTctal + r'c Within 



(b 



Ti*o- T<r av ?!!OVJ 
THxed Ef foots 



est, Vx- rscols-tC-l)?'?; Error ( c ) 
t«c Error + eg Total 

est. v; 2 y/z =srFows- (P-prs Frror 
MP Error + SS Total 

est. w 2 ^/xz== Frint.- (P-l) (C-l) M SError 
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(a) L is taken to renre^nt the smallest number of rows cr 
columns, whichever is sraller. 

(b) In this case, Orvo.aa Frruared obviously rc-.presents 

the decrree of *trencth of the main effect. (J=# aroups) 

(c) Those three formulas ar« used, reflectively, for 
comutina Cneaa f^uared for Columns, Povs," and Inter- 
action effects. (P=* res; C=i* colunns) 
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The t and F distributions are used nost frequently 
by sneech communication researchers. After running a t 
test between sarnie means, the researcher has only to 
anplv the formula for omega scuared to obtain the per- 
cent of the variance accounted for bv the groupings. 
Omeaa smiared, live the other measures, represents the 
relative reduction in uncertainty about the value of the 
dependent variable given knovledqe of the independent 
variable. 

T1 hen the r test employed, the determination of 
the strencth of association rust natch the particular 
model of analvnis of variance « For the fixed effects 
model, one vay ANOVA , the variation in the dependent 
variable i<= due to (1) the variance caused by the inde- 
pendent variable and (2) error variance. Omeaa squared, 
therefore, crives the proportion of the total dependent 
variable variance attributable to the independent vari- 
able. Thiq same principle is expanded for the fixed 
effects, t*<o-wav AWA. The total variation is due to 
the tvo treatments, the interaction, and error. Omega 
seruared reveals the strength of association between the 
dependent variable and these influences. 

For the one and tt-«c-t'av random effects ANOVA the 
nercent variance calculations are just as simple but are 
bared on a different theoretic substructure. Measures 



of association for the cne-^av is bv the intra-class 

correlation coefficient and for the t^o-vay is by omega 
30 

sauared. Obviously, for mixed effects models of AN OVA, 
the measures are eauallv easy to apnly. For more complex 
AITVA desians, Vaucrhn and Corballis have suggested appro- 
priate formulas for calculating the percent influence of 

31 

the independent variables on the dependent variables. 

Expected Magnitude of Independent Variable Effects 

The immediate reaction of researchers vho report 

the nercent variance values nay be one of pessimism about 

the results of their research. A rruick look at r 2 values 

shows that a verv snail amount of explained variance is 

sufficient to ^roduce statistical significance. For 

example, \?itb an N of 100 a zero-order correlation of 

.1946 i? sufficient to be statistically significant at 
32 

the .05 level. The nercent variance value of this sig- 
nificant r is .0378. Orlv 4^ of the dependent variable 
variance is accounted for by the independent variable 
that v?ar significantly related to the dependent variable. 

A researcher using the F distribution, therefore, 
should not be too surprised to find that his significant 
relationship onlv explains a very small amount of the 
dependent variable variance. Placina Qualitative judg- 
ments on these values will be somewhat difficult but 
Cohen sugrests that those judoments can be made. He 



lie writes that an F ter-t that explains 14% of the 
variance should he considered, to have explained a 
large amount. Though the relative merits of the percent 
amounts nrobahlv cannot be determined a priori , if speech 
communication researchers begin computing percent vari- 
ance values , then the actual values found in research- 
can he the basis for comparison. 

The efforts associated with computing and comparing 
the percent of variance explained will yield beneficial 
results. Fir*t, if percent variance values become the 
accepted nractice for publications, researchers vill be 
forced to grapnle with the relative importance of their 
selected independent variable or variables. As a result , 
authors will be less li?'ely to confuse relative importance 
of a variable trith its statistical significance. 

Second, the standard reporting of percent variance 
value? will serve an auxiliary function of providing 
information about the effects of independent variables 
that did net achieve statistical significance. If a 
researcher used a small sample size, the independent 
variable* may have had a large impact on the dependent 
measure and still not achieved statistical significance. 
Rerortina the percent variance accounted for, therefore, 
may hiorhlioht relationship that need to be pursued in 
future research. 
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^■nd, finally, the loncwranae value from percent 
variance reporting is a more accurate estimation of the 
relative importance of independent variables, which 
will allow for direct comparisons between theories, 
"hile percent variance values apply only to the sample 
under stud", theories can be evaluated in terms cf their 
ability to explain dependent behavior. In addition , 
unless percent variance values are computed, our current 
renortincr Practices preclude construction of estimates 
of the predictive ability of theories. 

Present Reporting Practices 

Initially, the authors had a three-fold goal. First, 
to demonstrate the necessity to examine communication 
behaviors; second, to illustrate how research reports 
could report the maanitude of association between inde- 
pendent and dependent variable/ and, third, to compute 
measures of association for the part five vears o^ 
research published in Speech Monographs . The fulfill- 
ment of these three objectives would provide an extensive 
overview of the current status of theory in speech 
communication. 

Radlv, it is impossible to assess the maanitude of 
association extant in published research in speech 
communication, ^o^t research reports utilize the F 
test and do not provide t u e necessary information for 
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ohservaticn of the effects attributable to the independent 
variable (c) . «n UJ reoorts usuallv onlv report the value of 
the f ratio (F»5.20, 3=50 d.f.) without the necessary 
accompanying information. The formulas in Figure 4 reouire 
that complete ANOVR tables be reported so that essential 
information ?s nresent. 

Journals o-F communication research should immediately 
reouire (and "emit) authors to report complete information 
on *wnv/, tests. Unless the journals alter their practices, 
then (1) the estimation of independent variable effects is 
imno«$H.ble, (2) the comparative testing of theories rrin 
not ^e successful and (3) comprehensive theory development 
* T .I11 be blocked . 

Our theories are talfcina past one another. f'e nee( i 
to start establi^bina linkeages between the ma.icr variables. 3 
Different theories need to he cast anainst one another in 
the same exneriment, and independent variables derived 
from the theories need to be comnared across experiments. 
*n<3 the focus rf our research needs to be on dependent 
communication behaviors. Until sneech communication schola rs 
re-evaluate the current practices in conducting and reportinq 
exneri^ntSy comrehensive theory covelonrent elude us # 
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